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Chapter 2: Discrete Random Variables 


1- Basic Concepts 


= Random Variable 


A random variable ais a measurable function_X:Q — E, 0. as the set of possible outcomes and E a 
measurable space. 


= Remark: 


= In this course, we are interested in real-valued functions, as a consequence, the set E is IR or a subset of R. 


= Example: 


= The experiment of rolling a die twice. We can define the function « maximum of the two rolls » as a 
random variable. 

= Inthe exepriment of tossing a coin. The function that assigns the value « O » to the result of getting a 
Head, and « 1 » to the result of getting a tail is a random variable. 
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Chapter 2: Discrete Random Variables 


1- Basic Concepts 


= Random Variable 


= Arandom variable is a real-valued function of the outcome of the experiment. 
# Arandom variable can be conditioned on an event or on another random variables. 


= There is a notion of independence of a random variable from an event or from another random variable 


# Discrete Random Variable 


= Arandom variable is discrete if its range is either finite or countably infinite. 


= Notation 


= In general, we will note a random variable using a capital letter such as X, and any possible value of X will be 
denoted lower-case x. 
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Chapter 2: Discrete Random Variables 


2- Probability Mass Function 


= Probability Mass Function 


A discrete random variable is characterized by a probability mass function, also called shortly PMF, and 
denoted py. 


Px(x) = P({X = x}) 


PME is the probability of the event {X = x} consisting of all outcomes that give rise to a value of X equal to x. 
Note that (Very Important) 


> px(x) =1 
xeEE 
x ranges over all possible values of X, and the events {X = x} are distjoints and form a partition of the 


sample space. 
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Chapter 2: Discrete Random Variables 


2- Probability Mass Function 


= Notations 


= We will usually write P(X = x) instead of P({X = x}). 


= To denote the probability that a random variable X takes a value in a set S, we will use P(X € S). 


= Example: 


Consider the experiment of tossing a fair coin twice. Let X be the number of heads obtained. Then the 
~if x=O0orx=2 

sifx=1 

0 otherwise 


PME of X is py (x) 


= Express P(X € S) using py(x) where S € 0) 
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Chapter 2: Discrete Random Variables 


2- Probability Mass Function 


= Examples of known probability mass functions 


Bernoulli random variable 
The bernoulli random variable models the success/fail of an experiment. It takes two possible outcomes: 1 if 
the experiment is a success or 0 if it is a fail. 


li 
y= if success 


Oif fail 
The PMF of a Bernoulli random variable is 


ifx=1 


_{P 
mx) ={t feo 


We will say that X is a Bernoulli variable with parameter p. 
In general, Bernoulli random variable is used to model experiments with only two possible outcomes. 
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Chapter 2: Discrete Random Variables 


2- Probability Mass Function 


= Example of experiments that can be modeled using Bernoulli random variable 


= The state of a telephone at a given time that can be either free or busy. 

= Aperson who can be either healthy or sick. 

= The preference of a person who can be either for or against a certain political candidate. 
= Atoss of acoin ©. 
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Chapter 2: Discrete Random Variables 


2- Probability Mass Function 


= Examples of known probability mass functions 


Binomial Random Variable 
X is a Binomial variable of parameters n and p if the PMF of X consists of the binomial probabilities such that 


px(k) = P(X =k) = (|)p*(1— p)"“, fork = 0,1,..,n 


Here, we use k instead of x for convenience, and to emphasize that the outcome is an integer number. 
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Chapter 2: Discrete Random Variables 


2- Probability Mass Function 


= Examples of known probability mass functions 


Geometric Random Variable 
Suppose we repeatedly and independently toss a coin with probability of head equal to p, where 0 < p < 1. 
The geometric random variable is the number X of tosses needed for a head to come up for the first time. 


Its PMF is given by 


px(k) = (1—p)*"1p, k = 1,2... 


= Exercise: 
Why this is a legitimate PMF? 
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Chapter 2: Discrete Random Variables 


2- Probability Mass Function 


= Examples of known probability mass functions 


= Uniform Random Variable 
= Auniform random variable has a PMF given by 


px(k) ==, k =0,1,2,..,.N-1 
where NV is a strictly positive integer parameter characterizing the PMF. 


= Example: 


= Rolling a fair die once follows a uniform distribution 
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2- Probability Mass Function 


= Examples of known probability mass functions 


= Poisson Random Variable 
= A poisson random variable has a PMF given by 


k 
px(k) = et, k= 0,1,2,.. 


where A is a positive parameter characterizing the PME. 


= Example: 
In general, Poisson distribution is used to predict or explain the number of events occurring within a given 
interval of time or space 


= Exercise: 
e Why this is a legitimate PMF? 
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Chapter 2: Discrete Random Variables 


2- Probability Mass Function 


= The histogram of a random variable: 


The histogram of a random variable measures the number of occurrence of an event. It gives a general idea 
on the probability mass function. 


= Exercise: 
Match the histograms to the PMF 


Wahrscheinlichkeit 


0.05 0.10 0.15 0.20 0.25 


0.00 


im, Ak 3 k= [4] —_ == —_ (n k n-k 
kl’ px(k) = (1—p)*“p, KK) = PX =k) = (OP (1 — p) 
a eee a ee «| 
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2- Probability Mass Function 


=» The histogram of a random variable: 


0.40 


Wahrscheinlichkeit 


0.35 
0.30 
=> 0.25 
£0.20 
© 0.15 
0.10 
0.05 


0.00 0.05 0.10 0.15 0.20 0.25 


0.00 ———* 


Assignment (to be uploaded on Canevas on Monday March 6*): 

Propose a code to generate the histograms of Bernoulli, Binomial, Geometric, and Poisson distribution 
based only on a uniform random variable. 

Draw the histogram of the 4 distributions , using your code. 

Find a ready to use commands to plot the histogram of the 4 random variables. And draw the histograms 
using these commands. 

Show that the poisson PMF with parameter A = np, with n very large and p very small can be approximated 
with a Binomial PMF. 

Compute the Poisson PMF for k=5, and compare when using a Binomial with n=100 and p=0.01. 
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3- Functions of Random Variables 


= Functions of Random Variables 


We consider X a random variable, let g:Q — R_be a function , we use the representation Y = g(X) to define 
a new random variable which outcomes are given by g(x), in particular 


Dy (y) = Liaw Dx (x) : 


= Example: 


= Let Y = |X| and let us apply the preceeding formula for the PMF py(y) to the case where 


1 oe 
Dx (x) = 9 if x _ 4, 3, Zi 1,0,1,2,3,4 
0 otherwise. 


What are the possible values of Y? and what is py(y)? 
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